# Toxicity Detection

A RoBERTa-based text classification model for detecting toxic prompts and responses in dialogue systems

A Roberta fine-tuned classification model for evaluating the toxicity level of responses.

ToxicityModel is a fine-tuned model based on RoBERTa, designed to assess the toxicity level of English sentences.

This reward model is trained to predict which generated answer humans would prefer for a given question. Suitable for QA evaluation, RLHF reward scoring, and toxic answer detection.